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ABSTRACT 


■V 

Most  game-playing  programs  make  each  move  after  conducting  only  a  partial 
search  of  the  game  tree  and  applying  a  static  evaluation  function  at  the  terminal 
nodes  of  that  partial  search.  Given  limited  resources,  what  is  the  optimal  partial 
search  to  perform?  This  report  presents  a  model  for  investigating  -this  question. 
'Results  (including  the  answer  to  the  above  question)  are  obtained  for  a  restricted 
case  of  the  model. 


1.  hitroduction 

Scarcity  is  the  cornerstone  of  economic  theory.  With  chip  technology  growing 
by  leaps  and  bounds,  some  deny  the  relevance  of  scarcity  to  computer  problem 
'solving.  "Just  buy  a  bigger  machine,"  they  say.  Yet  some  search  tasks,  like  the 
'travelling  salesman  problem,  chess-playing  and  optimal  circuit  design,  have  decision 
trees  so  huge  as  to  preclude  complete  search  in  any  current  technology.  This 
necessitates  partial  search,  implemented  by  applying  a  heuristic  evaluation  function 
to  certain  interior  nodes  of  the  decision  tree.  The  job  of  the  evaluation  function  is  to 
provide  information  about  the  subtrees  below  the  evaluated  node. 

This  report  is  an  investigation  of  the  search  strategy  rather  than  the  move 
strategy,  that  is.  which  nodes  should  be  evaluated  as  opposed  to  what  decision 
should  be  made.  A  simple  search  strategy  is  uniform  depth  1  search:  evaluate  each 
possible  move  directly,  and  select  that  which  appears  best.  Such  a  strategy  is  like  a 
child  to  whom  "tomorrow"  is  synonymous  with  all  the  future.  As  the  child  grows  to 
understand  "next  week"  and  "three  years  hence",  so  might  our  strategy  expand  to 
uniform  depth  S  search,  depth  3  search,  and  so  on. 

The  "combinatorial  explosion”  [NILS  80]  of  most  search  problems  keeps  the 
aaaroh  depth  embarrassingly  smalL  Fear  of  the  "horizon  effect"  [THUS  82],  wherein 
Important  information  lies  Just  beyond  the  deepest  level  searched,  encourages 
abandonment  of  uniform  search.  Instead,  certain  "promising"  lines  are  searched 
deeply,  while  other  possibilities  are  left  unexplored.  Such  search  is  patterned  after 
"Insight",  a  typically  human  thought  process. 

These  search  strategies  and  others  have  long  been  known  to  the  game-playing 
oommunlty  [BIER  78].  The  question  of  which  strategy  is  best,  however,  remains 
unanswered.  This  report  presents  a  model  for  investigating  where  In  the  decision 
tree  limited  searoh  resources  should  be  expended  in  order  to  aid  decision-making. 
Analytic  results  are  obtained  for  a  restricted  ease. 


z 


t.  The  model 

t.l.  that  every  good  model  should  be  able  to  do 

r 

"  We  wish  to  study  the  situation  wherein  limited  resources  prevent  complete 
?  search  to  the  end  of  the  decision  process.  Perforce,  uncertainty  as  to  the 
correctness  of  our  choices  enters  the  stage.  Uncertainty  arrives  in  decision-making 
from  many  sources,  including  unpredictable  opponents,  other  external  events,  errors 
In  the  evaluation  function,  and  incomplete  search.  Our  model  must  isolate  this  last 
source  of  uncertainty. 

Our  model  must  also  make  clear  the  distinction  between  a  search  strategy  and  a 
move  strategy.  The  following  example  was  suggested  by  conversations  with  Tom 
Truscott  about  minimum  variance  search  [THUS  79]. 

Prudence,  appearing  on  "Let's  Make  A  Deal",  must  choose  either  what  is  in  the 
box  beside  her  or  what  is  behind  the  curtain  on  the  stage.  She  knows  (because  she 
bribed  a  trusted  stagehand  before  the  show)  that  the  box  contains  $2000  in  cash. 
Careful  records  of  the  last  forty- six  episodes  of  the  show  indicate  that  the  average 
curtain-item  has  value  $1417,  although  some  items  behind  the  curtain  have  been 
worth  as  much  as  $5000.  Clearly,  her  move  strategy,  based  on  current  information, 
must  be  to  take  the  box.  But  her  search  strategy  should  be  to  further  explore  the 
curtain,  for  example  by  signalling  her  thirteen-year-old  cousin  Ozxy  to  sneak  behind 
it.  The  model  herein  must  define  precisely  the  notion  of  strategy,  with  both  its 
components.  Further,  it  should  allow  quantitative  comparison  of  strategies. 
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t£.  Playing  fame* 

We  model  a  decision  process  by  a  one-player  game  played  on  a  game  tree.  The 
game  tree  may  have  any  shape  desired;  the  shape  Is  known  to  the  player.  Each  of 
■  the  leaves  (called  goal  nodes)  of  the  game  tree  has  a  value,  which  tqay  be  any  real 
?  number.  The  player  begins  at  the  root  and  makes  sequential,  irreversible  moves 
until  he  reaches  a  goal  node.  The  value  of  that  node  is  the  score  the  player  achieves. 
The  player  is  trying  to  maximize  his  expected  score. 

It  remains  to  deolare  what  information  the  player  may  acquire  from  search  of 
the  game  tree.  First  we  enrich  our  vocabulary. 

Definition:  To  move  randomly  at  a  node  means  herein  that  the  probability  the 
player  moves  to  one  child  is  the  same  as  the  probability  he  moves  to  any  other 
ohild  of  that  node.  Suppose  a  player  moves  randomly  from  node  w  until  the  end 
of  the  game.  Then  the  score  the  player  will  achieve  is  a  random  variable  Jfj, 
called  the  Mind  search  value  of  node  w .  Its  probability  mass  function  (pmf)  p, 
is  called  the  Mind  search  pmf  of  node  w  and  its  expectation  K[J^]  Is  called  the 
Mind  aearch  expectation  of  node  w . 

Definition:  To  explore  node  w  in  the  game  tree  means  to  be  told  the  blind  search 
pmf  pw  of  node  i». 

At  any  time  during  the  gams,  the  player  may  explore  any  node  In  the  tree.  This 
exploration  models  the  generation  of  accurate,  consistent,  yet  incomplete 
Information  from  search.  Further,  the  exploration  is  generic  in  nature,  being  tied  to 
no  particular  game. 

To  model  limited  resouroes,  we  associate  a  cost  of  $1  with  each  exploration  of  a 
node.  The  player  begins  with  a  limited  but  known  budget.  Generously,  we  give  the 
player  the  blind  search  pmf  of  the  root  of  the  game  tree  free  of  charge.  ' 


E3.  KIbitiing 

Definition:  A  search  strategy  is  a  collection  of  rules  that  specify  which  nodes  of  the 


game  tree  are  to  be  explored  at  what  times.  A  move  strategy  is  f  collection  of 
rules  that  specify  what  moves  to  make  during  the  game.  A  strategy  is  the  union 
?  of  a  aearoh  strategy  and  a  move  strategy. 

The  search  and  move  strategies  may  be  dynamic  and  may  communicate.  That  is, 
the  result  of  one  exploration  or  move  may  partially  determine  the  succeeding 
portion  of  the  search  and  move  strategies.  The  strategies  may  also  be  probabilistic. 
The  player  is  assumed  to  have  a  true  random-  number  generator  at  his  disposal. 

Let  us  review  the  current  status  of  our  modeL  Someone  (say  Zeus)  has  supplied 
three  game  parameters: 

1.  the  shape  of  the  game  tree, 

8.  the  blind  search  pmf  of  the  root  of  the  tree,  and 
3.  the  player's  budget. 

The  player  knows  the  values  of  these  three  parameters.  He  brings  with  him  a 
strategy,  as  defined  above. 

At  tins  point  the  player  could  play  the  game,  achieving  some  fated  result.  But  as 
many  gamblers  have  found  to  their  dismay,  there  is  a  difference  between  the  winning 
play  and  the  correct  one  (obtained  by  playing  the  odds).  Ye  are  interested  in 
evaluating  the  average,  rather  than  actual,  score  yielded  by  the  player’s  strategy.  To 
police  and  evaluate  a  strategy,  we  introduce  a  meta-player  (HP). 


The  IIP  simulates  the  player's  strategy  mi  each  possible  game  tree.  Recall  that 
ly  game  trees  are  possible  from  the  player’s  viewpoint,  because  although  the 


player  knows  the  blind  search  pmf  of  the  root,  he  does  not  know  which  goal  nodes 
have  which  goal  values.  The  eards  have  been  dealt  but  not  yet  seen.  For  any 
assignment  of  goal  values  to  goal  nodes  consistent  with  the  given  root  blind  search 
pmf,  the  HP  simulates  the  player's  strategy  to  find  an  average  (expected)  score.  This 


•core  it  an  average  rather  than  a  single  number  because  of  possible  probabilistic 
aspects  of  the  player's  strategy.  The  average  is  weighted  according  to  the 
probability  distribution  specified  by  the  player  in  his  strategy. 

r" 

Once  these  average  scores  are  computed,  the  MP  averages  them  over  all  possible 
game  trees.  How  to  weight  this  average  has  not  yet  been  specified.  It  is  reasonable, 
given  the  laok  of  additional  information,  to  assume  that  all  such  game  trees  are 
equally  likely.  For  emphasis,  here  is  a  precise  statement  of  this  assumption. 

Heta-player  assumption:  Let  a  given  game  tree  have  shape  f,  and  let  its  root  have 
pmf  pf.  Label  its  goal  nodes  g  =  (p pB.  ••• .  gn).  Let  T  be  the  set  of  all  possible 
assignments  of  goal  values  v  *(w|,  va.  •  •  • ,«%)  to  the  goal  nodes,  consistent 
with  I  and  pr.  We  assume  that  alt  the  elements  of  T  are  equally  likely. 

B.4.  A  strategy  unmasked 

Enough  of  description!  Watch  the  MP  in  action  as  he  evaluates  a  strategy. 

Zeus  sends  us  a  complete,  binary,  depth  two  tree.  He  says  the  root  blind  search 
pmf  iv  Is: 

I*r(l)  *  Pr(0)  *  J 

The  only  trees  consistent  with  these  specifications  are  those  with  two  goal  nodes 
having  value  "1"  and  two  having  value  "0".  There  are  six  such  trees,  pictured  In 
Figure  1. 
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Figure  1. 


The  player  Prometheus  brings  the  following  $1  strategy. 

1.  He  explores  the  left  child  ft  of  the  root  (spending  his  $1  there)  and  computes 
K[JK»]  from  the  information  purchased.  He  computes  E [A^]  =  l  - E[X*\  Then 
Prometheus  moves  to  the  child  with  larger  expectation;  If  the  expectations  are 
tied,  he  makes  his  first  move  randomly. 

8.  Prometheus  makes  his  second  move  at  random. 

Note  that  Prometheus  has  used  his  god-given  knowledge  of  root  prof  j>s  in  his 
Strategy. 

To  evaluate  this  strategy,  the  MP  plays  the  game  using  the  strategy  on  each  of 
the  six  trees  above.  For  example,  on  the  first  tree  pictured,  the  search  strategy 
that  C[A^]  6  0  and  K[A«]  *  I,  so  Prometheus  moves  to  node  c.  He  then 
moves  to  either  node  /  or  node  g  (at  random),  sooting  a  "1"  in  either  case.  The  MP 
records  that  Prometheus*  strategy  yields  a  score  of  "1"  on  tree  1. 

Next  the  MP  tries  Prometheus'  strategy  »n  Tree  E  (the  middle  tree  in  the  first 
row  In  Figure  1).  This  time 


Bft]  =  t[*]  =  0.5 


The  player  makes  both  of  bis  moves  at  random  in  Tree  2,  receiving  a  score  of  either 
"1”  or  M0”  but  averaging  a  score  of  0.5.  The  HP  records  that  Prometheus'  strategy 
'yields  an  expected  score  of  0.5  on  Tree  2.  Note  that  this  is  an  expected  (average) 
^acore.  In  none  of  the  six  trees  in  figure  1  can  the  actual  score  be  0.5. 

Analysis  of  Trees  3  through  5  is  symmetric  to  that  of  Tree  2.  Analy  '  of  Tree  6  is 
symmetric  to  that  of  Tree  1.  The  meta?player  assumption  says  that  t  ix  trees  are 
weighted  equally.  The  HP  evaluation  of  this  strategy  is  the  average  of  evaluation 
on  each  tree,  ie., 

(1.0  +  0.5  ♦  0.5  +  0.5  +  0.5  +  1.0)  *  6  *  | 

2 

In  no  game  does  Prometheus  aotua&y  receive  a  score  of  — .  His  strategy  works 

9 

better  than  this  average  on  some  trees  and  worse  on  others.  When  we  compare  two 
strategies,  we  will  not  claim  that  one  strategy  outperforms  the  other  on  all  possible 
games,  but  only  that  one  has  higher  average  score  than  the  other. 


8.  Restricting  the  Model  to  limited  Strategies  on  0-1  Unary  Trees 


8.1.  The  Restrictions 

In  this  section,  we  restrict  the  mode]  in  three  ways. 

"X-  All  trees  are  finite  complete  binary  trees. 

E.  "0"  and  "1”  are  the  only  two  goal  values  allowed. 

3.  The  only  strategies  allowed  are  thoSe  of  the  following  form: 

a.  The  piayer  moves  randomly  until  he  reaches  node  w  at  depth  A  — 1 
(0  <  k  - 1  <  depth  of  tree). 

b.  The  player  explores  the  two  depth  k  children  of  node  tu.  From  the 
probability  distributions  received,  he  computes  the  blind  search 
expectation  of  each  of  these  children. 

c.  The  player  moves  to  the  child  whose  blind  search  expectation  is  the  larger 
of  the  two. 

d.  The  player  moves  randomly  for  the  rest  of  the  game. 

Call  such  a  strategy  the  one  time  k  strategy. 

88-  Definitions 

Note  that  in  our  model  a  finite  complete  binary  0-1  tree  can  be  described  by  two 
parameters: 

p  *  number  of  goal  nodes  with  value  ”1",  and 
n  *  number  of  goal  nodes. 

This  justifies  the  following  definition. 


Definition:  A  (j>,«)  tree  it  a  complete  binary  tree  with  n  goal  nodes  of  which  p 

have  value  ”1"  and  the  rest  have  value  M0". 

Note  that  the  blind  search  expectation  of  a. (p.n)  tree  is  the  avvage  goal  node 

value,  ie.,  . 
n 

The  blind  search  expectation  of  a  tree  is  the  stick  by  which  we  measure  the 
player’s  performance.  It  is  the  outcome  we  would  expect  the  player  to  average  if  he 
were  to  play  the  game  many  times  with  no  information  to  guide  him.  The  question 
thus  arises:  How  much  will  information  help  the  player?  The  function  in  the  next 
definition  tells  how  much  the  player  is  helped  by  information,  in  this  restricted 
version  of  the  game. 

Definition:  The  random  variable  Ifk.p.n )  is  the  improvement  for  a  (p  ,n)  tree  that  a 

player  gains  over  its  blind  search  expectation  by  using  the  one-time  I:  strategy. 

Ut/»(p.n)  denote  its  expected  value  X  [/(£p ,«)]. 

The  randomness  in  the  random  variable  /(A  p.n)  arises  from  two  sources:  the 
randomness  in  the  player's  strategy  and  the  random  (p.n)  tree  selected.  The 
former  randomness  obeys  a  uniform  distribution  when  the  player  is  using  a  one-time 
k  strategy.  The  latter  randomness  obeys  the  uniform  distribution  given  by  the 
meta-player  assumption,  ie.,  that  all  (p.n)  trees  are  equally  likely. 

/*(p.n)  does  not  give  an  actual  score  the  player  will  receive  in  any  particular 
instance  of  a  game  played  on  a  (p.n)  tree.  His  strategy  will  work  better  in  some 
Instances  and  worse  In  others,  /*(p.n)  is  an  average  over  all  possible  games  played 
on  (p.n)  trees. 
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8.3.  Results  and  Conjectures 

This  seotion  answers  many  interesting  questions  about  the  strategies  in  this 
restricted  model.  For  each  statement  labelled  "Result",  its  proof  either  follows  the 
“  statement  or  is  in  Appendix  A.  The  statements  for  which  no  explicit  proof  appears 
’  ere  labelled  "Conjecture"  and  are  supported  by  the  computer  results  in  Appendix  B. 

Unless  otherwise  stated,  results  about  / *(p.n )  are  for  integers  k , p .  n,  with  n  a 
power  of  2  (n  at  3).  0  <p  £n,  and  1  <  A  <  log  n.  Throughout,  (* )  denotes  "z  choose 
y "  and  is  interpreted  as  0  if  x  <  y .  Logarithms  are  base  2.  The  symbol  ■  denotes  the 
end  of  a  proof. 

8.8.1.  Computational  Results 

On  the  average,  how  much  should  the  player  expect  to  gain  by  doing  a  single 
exploration  of  two  adjacent  subtrees  at  level  A  of  a  ( p.n )  tree?  That  is,  how  does 
one  compute  fit  (p.n)?  The  results  of  this  section  give  formulas  for  doing  that 
computation.  These  results  justify  the  programs  written  to  compute  /i(p.n)  and 
for  various  values  of  k,p  and  n. 

/*(P.»)  *  /s(n-p.w). 

Proof:  Appendix  A  (section  5.1).  ■ 

This  espressos  the  0-1  symmetry.  Recall  that  p  and  n-p  are  the  number  of 
goal  nodes  with  values  "1"  end  "0"  respectively.  This  result  says  that  the 
Improvement  gained  from  a  single  exploration  of  two  adjacent  subtrees  In  a  tree  with 
p  *T*e  Is  exactly  the  same  (on  average)  as  that  gained  in  a  tree  with  p  "0"s. 

This  result  does  not  say  that  the  average  score  achieved  Is  the  same  in  the  two 
eases.  It  says  only  that  the  expected  increase  from  the  two  (different)  no-search 
•cores  is  the  same.  Note  that  the  result  applies  no  matter  when  the  one-time 
exploration  is  performed. 
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Most  of  the  following  formulas  are  true  for  all  values  of  p,  but  the  programs  use 
Result  1  to  halve  the  computational  effort. 

Result  2:  f 


'/  i(p.n)  = 

¥ 

to -*]<?)< 

»<n/e>  • 

*l*/S  +  ll  * 

4 

I  n-p+1 

’  »'<«%> 

l  2 

t  r  \  t  n“P  \ 

4p/2  +  iJ'  4 («-*>+!)/  zr 


0 


1_ 

n 

^-/i(p-l.n) 


if  p  =0  or  p  =n 
if  p  =1  or  p=n-l 

if  2  d  p  <  n  — 2  and  p  is  even 

if  3<p  <b-3  and  p  is  odd 


0 


if  p  =0  or  p»n 


1  1  Yf 1  n  -  2j  IfrdQ/tJ  ei  +  1 
w  /•»  n  -2/  -f  1  /„{  2, 


if  1  if  sc n  — 1 


Proof:  Appendix  A  (section  5.2).  ■ 

These  formulas  give  ways  to  compute  /  j(p.n).  The  next  result  will  give  /*(p,n) 
in  terms  of  fx. 

The  first  formula  in  Result  2  is  the  naive  computation  of  ft (p.n).  Its  proof  is 
illustrative  of  the  combinatorial  meaning  of  /i(p.n).  Exploring  at  the  root  of  the 
tree  means  splitting  the  goal  nodes  into  two  halves  and  choosing  the* half  with  more 

*,l"-valued  goal  nodes.  In  the  first  formula,  the  denominator  (n^g)  is  the  number  of 


ways  to  divide  the  n  goal  nodes  into  two  halves.  The  sum  is  over  the  cases  when  j 
ones  and  n/2  —  j  zeros  are  in  the  selected  half.  The  last  two  "choose"  terms  In  the 
formula  give  the  number  of  ways  to  do  the  split  in  cue  j.  The  improvement  in  each 

case  is  the  2j  —  p  term  inside  the  sum  times  the  —  term  outside  the  sum.  The  factor 

n 

of  2  exists  because  of  the  symmetry  of  the  cases  and  the  fact  that  whichever  half  has 
more  "l"-valued  goal  nodes  is  selected. 

The  first  formula  is  a  short  sum'  but  suffers  from  including  terms  with  large 
integers.  In  particular,  (n*g)  is  too  large  for  a  POP  11/70  double  variable  (64  bits) 
when  n  fe  256  (depth  8  trees). 

The  second  formula  is  a  closed-form  version  of  the  first  formula.  It  eliminates 
the  short  sum  but  suffers  the  same  difficulty  with  large  integers.  Its  proof  consists 
only  of  combinatorial  tricks  applied  to  the  first  formula. 

The  third  formula  gives  the  recursive  definition  used  by  the  programs  to 
compute  /i(p,n).  The  basis  case  is  when  j>  is  1;  the  recursion  is  onp.  / i(p.n)  is 
easily  computed  by  this  formula  even  for  very  large  trees.  Note  the  difference  and 
symmetry  of  the  odd/even  cases.  Result  6  states  more  clearly  how  /t(p,n)  changes 
os  a  function  of  p.  The  proof  of  the  third  formula  is  by  induction  using  the  second 
formula.  The  difference  in  the  odd/even  cases  occurs  because  the  terms  truncated 
In  the  second  formula  depend  on  whether  p  is  odd  or  even. 

The  fourth  formula  in  Result  2  is  a  non-recursive  application  of  the  third 


formula. 
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Result  3:  fork  *2, 

/,(!>.«)  =  -J—  £  (?)  (*“')  f.lf.m) 

(«)  ,-o  /  f 

where  m  =  —r— 7- 
£*_1 

Proof:  In  the  one-time  k  strategy,  the  player  explores  two  randomly  selected 

adjacent  subtrees,  each  with  root  at  level  k  of  the  (p.n)  tree,  and  moves  to 
whichever  subtree  has  more  goal  nodes  with  value  "1".  In  other  words,  the  player 
moves  to  a  random  node  tu  at  level  fc  —  1,  and  applies  the  one-time  1  strategy  to  the 
subtree  with  root  w. 

Divide  the  possible  outcomes  into  cases:  case  j  means  the  node  w  subtree  has  j 
goad  nodes  below  it  with  value  "1".  Since  node  iv  is  at  level  Jk  —  1.  the  expected 
improvement  over  blind  search  in  case  j  is  where  m  =  size  of  the  node  w 

subtree  =  . 

2*_I 

We  must  weight  each  case  appropriately.  The  number  of  ways  to  select  the  j 
goal  nodes  with  value  "1"  in  the  node  w  subtree  is  ).  The  number  of  ways  to  select 
the  remaining  goal  nodes  in  the  node  w  subtree  is  (*“^).  There  are  (^)  ways  to 
select  a  subtree  with  root  at  level  fc -1,  so  the  weight  of  case  j  is 


(?)  C'-S) 


Multiplying  the  expected  result  for  each  case  by  the  weight  of  that  case  and 
summing  over  all  the  oases  yields  Result  3.  • 

This  formula  expresses  /t(p,n)  in  terms  of  fx.  Tor  p  <  n/ 2,  the  non-zero 
barms  of  the  sum  are  those  tor  which  j  lies  between  0  and  min  (m,p  ).  For  p  >  n/  2, 


the  non-xero  terms  ere  those  for  which  j  ties  between  max  (0.  m  -  ( n-p ))  and  m.  In 
either  case,  the  formula  is  a  short  sum.  Note  that  the  sum  is  longest  (m  is  largest) 
when  k  «  2. 

T 

■  The  / 1  terms  are  easily  computed  from  Result  2.  However,  the  combinatorial 
Jterms  in  /*(p.*0  may  still  be  quite  large.  For  example,  /t  requires  (n*g)  which  is 
too  large  for  a  PDP  11/70  double  variable  (64  bits)  when  nk  256  (depth  8  trees). 
The  problem  in  calculating  /*(p,n)  lies  not  in  the  time  required  to  compute  the  sum 
hut  rather  in  difficulties  in  representing  quotients  whose  numerator  and 
denominator  are  both  quite  large. 

8.3.2.  Special  Cases 

This  proposition  gives  simple  formulas  for  /i(p.n)  and  /*(p.n)  in  three  special 
oases.  The  first  two  cases  are  cases  for  which  all  or  all  but  one  of  the  goal  nodes  are 
the  same.  The  third  special  case  is  a  nice  formula  for  exploration  at  the  bottom  of 
the  game  tree. 

Result  4:  /*(  O.n)  =  /*(n,»)  =  0 

/*(1.*0  *  /*(«-l.»)  *  £- 
/**  niP-*)  *  for  n  k  4 

Proof:  The  first  formula  follows  immediately  from  Result  2  and  Result  3.  The  (^)  or 
term  in  Result  3  is  always  Oifp  «  0  or  p  =  n,  except  for  the  j  =  0  or  >  *  m 
ease,  for  which  /i(J.m)  a  0  by  Result  2. 


The  second  formula  also  follows  from  Result  2  and  Result  3.  If  p  s  1.  the  sum  in 
Result  3  consists  of  two  summands,  the  first  of  which  is  xero  and  the  second  of  which 
Is  easily  found  from  Result  2.  The  p  =  n  -1  case  can  be  computed  similarly  or  by 


using  the  symmetry  in  Result  1. 

Tbs  third  formula  follows  from  Result  3  and  the  other  two  formulas  in  this 
result.  If  k  e  log  n,  the  sum  in  Result  3  consists  of  three  summands  {m  =  2).  The  fx 
'term  in  each  is  computed  from  the  first  two  formulas  in  Result  4.  ■ 

\  The  first  formula  above  says  that  trees  whose  goal  values  are  all  "0"s  or  all  'T’s 
do  not  improve  upon  closer  examination.  Trees  with  all  "0"s  are  hopeless  and  those 
with  all  "l"s  are  perfect  already. 

From  the  second  formula  we  see  that  exploring  trees  with  a  single  black  sheep 

1  2 

enables  the  player  to  double  his  expected  score,  which  improves  from  —  to  — .  It 

fl  A 

seems  surprising  that  the  improvement  is  independent  of  the  level  k  of  exploration. 

The  last  formula  above  gives  the  improvement  gained  by  exploring  at  the  last 
possible  moment,  that  is,  just  before  the  player’s  last  move.  The  formula  is 
pleasantly  simple.  Result  7.  Result  10  and  Result  14  further  explain  the  behavior  of 
fitg  m(p  .  »)•  Each  is  an  easy  corollary  to  Result  4. 

Other  special  cases  for  /*  can  be  similarly  computed  from  Result  3.  However,  as 
m  in  Result  3  increases  linearly,  the  number  of  terms  in  the  Result  3  sum  increases 
exponentially.  Application  of  Results  to  increasingly  large  subtrees  becomes 
computationally  difficult  quite  quickly. 

143.  Which  One-time  k  Strategy  is  Best? 

The  player  is  most  interested  in  how  he  should  play  to  maximise  his  game  score. 
He  wants  the  answer  to  the  question:  Otuan  a  (p.n)  free,  and  given  that  the  player 
can  explore  two  adjacwnt  subtrees  exactly  ones  In  the  game  buf  must  make  all  other 
moves  blindly,  whan  should  tht  play rr  do  that  exploration? 

The  corollary  to  Result  5  answers  this  question.  Result  5  is  the  stronger 


Statement  of  monotonloity. 
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■•suit  5  [Ballard  and  Hutchler] :  for  1  <  k  <  log  n, 

A(p.n)  *  *0 

r 

with  equality  iff  j>  =0  or  p  =1  or  p  =n  -1  or  p  =n. 

Further,  the  proof  does  not  depend  on  the  goal  node  value*  being  restricted  to 
"0"  and  "1",  and  works  for  any  complete  n-ary  tree. 

Corollary; [Ballard  and  Hutchler] :  for  1  <k  <  log  n, 

/s(p.«)  <  /  hc»<P.n) 

with  equality  iff  p=0  or  p  =1  or  p  =n  — 1  or p=n. 

Further,  the  proof  does  not  depend  on  the  goal  node  values  being  restricted  to 
H0"  and  Ml“,  and  works  for  any  complete  n-ary  tree. 

Proof:  The  proof  of  Result  5  is  in  Appendix  A  (section  5.3).  The  key  ideas  in  it  were 
produced  by  Bruce  Ballard  following  a  conversation  with  the  author.  The  corollary  is 
an  immediate  consequence  of  the  result.  • 

Result  5  is  the  strongest  result  in  this  report.  It  says  that  the  player  does  better 
(on  average)  at  each  moment  of  the  game  to  put  off  his  single  exploration  until  the 
next  move,  up  to  his  last  move.  The  corollary  is  immediate:  the  player  should  do  his 
single  exploration  at  the  last  possible  moment,  ie.,  just  before  the  player  makes  his 
last  move.  This  authoritatively  answers  the  question  of  which  of  the  strategies 
allowed  in  this  restricted  model  is  best. 

This  result  does  not  say  that  for  every  tree,  the  player  necessarily  will  do  better 
to  postpone  his  exploration.  For  example,  consider  the  second  through  fifth  trees  of 
Figure  1  in  Section  2.4.  If  the  player  explores  before  his  first  move  and  then  makes 
bis  second  move  at  random,  he  will  see  that  both  halves  yield  an  average  score  of  0.5. 
Which  he  will  achieve  (on  average).  In  those  tour  trees,  if  he  makes  his  first  move 


V-.~- 


randomly  and  then  explores  the  two  goal  nodes  beneath  him,  he  will  always  And  a 
goal  node  with  value  "l",  for  an  average  score  of  1.0.  In  those  four  trees,  the  player 
Is  better  off  postponing  the  exploration  until  prior  to  his  second  mover 

T 

But  now  look  at  the  first  and  last  trees  of  Figure  1  in  Section  2.4.  ;Jn  those,  if  the 
player  explores  before  his  first  move  he  will  move  toward  the  half  with  all  *T's,  for  an 
average  score  of  1.0.  But  if  he  postpones  exploration  until  after  his  first  move,  half 
of  the  time  he  will  find  only  "0,ls  below  him,  for  an  average  score  of  0.5.  The  player  is 
better  off  in  the  first  and  last  trees  to  explore  before  his  first  move. 

Result  5  says  that  if  we  average  each  technique  over  all  possible  trees,  assuming 
that  each  such  tree  Is  equally  likely,  then  the  player  does  better  (on  average)  to  do 
bis  exploration  at  the  lower  level  of  the  tree. 

Much  of  the  strength  of  this  result  lies  in  it  not  depending  on  the  values  of  the 
goal  nodes  being  restricted  to  "0"  and  "1".  The  proof  of  the  result  involves  no 
combinatorics.  It  uses  only  a  fundamental  property  of  the  "maximum"  function  and 
the  linearity  of  expected  value. 

This  result  suggests  that  a  similar  result  might  bold  If  the  player  is  allowed  to  do 
more  than  one  exploraUon.  Further  investigation  of  this  extension  will  be 
forthcoming. 

8.3.4.  For  Vhat  lYees  Does  Search  Most  Help? 

The  player  is  also  interested  in  knowing  for  which  trees  search  is  most  helpful. 
Result  4  says  that  search  doesn’t  help  at  all  if  the  goal  nodes  are  all  the  same. 
Results  8  through  8  answer  the  question:  At  what  game  tress  should  the  player  be 
most  willing  to  pay  for  tht  right  to  explore?  Ai  terms  of  our  model,  what  happens  to 
fo(p,n)  a*  p  varloa  from  0  ton,  while  k  and  n  are  hold  fixed? 


/»(#>.»)  >  /i(p-2.»)  if8*p*g. 

r 

/»<P.*0  >  / i(p+2.n)  1/  |ip<n-E 

/»(P*0  <  /i(p-l.n)  if  p  it  tvtn 
/  »(p.*0  >  / |{p— l.n)  if  pic  odd 

Jh  particular,  farjlxtd  n,  f  ,(p,  n)  it  largest  tuhm  p  =  - 1  or  pe-  +  l. 

is  IS 

Proof:  Appendix  A  (section  5.4).  ■ 

This  result  states  two  things,  first,  if  we  look  at  only  even  p  or  at  only  odd  p , 

then  /i(p.n)  increases  as  p  increases  until  p  reaches  midway  (|-);  then  /i(p,n) 

decreases  as  p  continues  to  increase  to  n.  This  relationship  is  illustrated  tor 
n  *  188  in  figure  8. 

like  second  relationship  ghren  by  this  result  is  that  /i(p,n)  is  bigger  for  odd 
values  of  p  than  for  either  even  neighbor.  That  is,  for  oddp. 

/i(P.«0  >  /i<P-l.w)  «»d  /i(p.n)  >  / ,(p+l,») 

This  relationship  is  illustrated  for  n  =  188  in  figure  3. 

Suppose  that  prior  to  his  first  move  the  player  will  do  a  single  exploration  of  the 
two  subtrees  beneath  the  root  of  the  game  tree.  For  such  a  player.  Result  0  means 
that  he  expects  to  learn  more  in  trees  whose  goal  nodes  are  about  half  "l”*  and  half 
Vi  than  in  trees  whose  goal  nodes  are  predominantly  "lMs  or  predominantly  "CTs. 

The  proofs  of  the  statements  is  Result  6  use  the  third  formula  in  Result  8.  The 
proofs  do  not  explain  the  odd/even  difference.  However,  one  would  expect  more 
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improvement  in  ( p.n )  trees  with  p  odd  than  in  those  with  p  even,  since  only  in  the 
•van  case  is  it  possible  tor  the  player  to  explore  and  nonetheless  achieve  no 
improvement  in  expected  result.  (This  happens  if  the  two  halves  of-  the  tree  each 
contain  exactly  half  of  the  goal  nodes  with  value  "l".) 

Result  7:  for  fixed  n  fc  4. 

*  fbgn(P'n)  I*  increasing  function  of  p  for  0 decreasing  for 
2-sS p  sK  «.  and  convex  throughout.  In  particular,  for  fixed  n  4,  fiotn(p<n)  i s 
largest  when  p  *  jjp. 

Proof:  From  Result  4, 


Viewing  this  as  a  continuous  function  of  jp,  we  see  that 


>0  if  0 %p  <  J 
-0  if  pcf 
<0  if  |-<p  <n 


Also,  ff/wt.fp.ft)  w  -2  <  0. 


The  result  for  integer  p  follows  from  the  continuous  case.  ■ 

Recall  that  /hg»(p.n)  gives  the  expected  improvement  when  our  strategy  is  to 
perform  our  one-time  exploration  at  the  last  possible  moment.  Result  7  and  Result  6 
•how  that  behavior  with  respect  to  proportion  of  goal  nodes  having  value  "1”  is  the 
imm  for  the  player  who  spends  his  money  at  the  last  moment  as  for-  the  player  who 
■pends  his  money  as  quickly  as  possible,  except  for  the  odd/even  dispan*  v. 


The  topmost  curve  in  Figure  4  illustrates  Result  7  for  n  =  128. 


Conjecture  8:  for  k  fc  2, 

fh(p.n)  is  an  increasing  function  of  p  for  decreasing  for 

c 

,  and  convex  throughout.  In  particular,  for  fixed  n  and  fixed  Jk  «e  2, 

/*(*>■*)  is  largest  when  p  =  ~ . 

This  conjecture  says  that  (except  for  /i(p.n))  the  graph  of  /*(p.n)  as  a 
function  of  p  is  convex  and  symmetric  about  .  Computer  results  in  Appendix  B 

verify  the  conjecture  for  n  <  128.  The  results  for  n  =  128  are  graphed  in  Figure  4.  It 
seems  highly  likely  that  the  conjecture  is  in  fact  true  for  larger  values  of  n  as  well, 
ie.,  that  all  one-time  k  strategies  behave  similarly  with  respect  to  the  make-up  of  the 
goal  values. 

3.3.5.  What  Happens  in  Large  Trees? 

Host  game  trees  are  very  large.  This  section  examines  the  behavior  of’/*  (p.n) 
in  large  trees.  The  results  answer  the  following  questions,  Oppose  that  tut  double 
the  number  of  goal  nodes  fie.,  add  a  level  to  the  traa)  while  maintaining  the  same 
proportion  of  goal  nodes  with  value  "l".  How  does  this  c/usnge  /*(p.n)?  Does  the 
behavior  converge  as  the  number  of  goal  nodes  gets  large ? 

RoeultS:  /,(2p,8n)  <  /i(p,n)  with  equality  iff  p  =0  or  p=n. 

Proof:  Appendix  A  (section  5.5).  ■ 

This  result  says  that  adding  a  level  to  the  tree  while  maintaining  the  same 
proportion  of  goal  nodes  with  value  "1”  causes  the  player  to  gain  less  (on  average) 
from  search,  provided  that  the  search  is  a  single  exploration  of  the  two  subtrees  of 
the  root  prior  to  bis  first  move.  The  result  is  believable:  in  the  expanded  tree  the 
player  receives  his  information  one  step  further  from  the  goal  nodes  than  be  does  in 


the  ■mailer  tree,  and  Result  5  says  the  player  is  best  off  receiving  his  information 
just  above  the  goal  nodes. 

Result  10:  /k**(2p,2n)  <  / i#t»(p.n)  with  equality  iff  p  =0  oivp=n. 


Proof:  from  Result  4. 


/ta,a(2p.2n)  =  2n(2n~-f) 


-  .8p(n-g) 
n(2n-l) 


c  gfc-gj 

n(n-l) 


*  /i0in(j>.u)  from  Result  4  again. 


Ifp  *0ory  =  n,  /iH*(2p.2n)  =  0  = /i**(p.n).» 

Again  we  add  a  level  to  the  search  tree  while  maintaining  the  same  proportion  of 
goal  nodes  with  value  Hl".  This  result  says  that  in  such  a  situation,  behavior  for  the 
player  who  searches  at  the  last  possible  moment  is  like  that  of  the  player  who 
searches  before  bis  first  move.  In  each  case,  the  player  expects  to  gain  more  from 
search  in  the  smaller  tree. 

Here,  however,  the  reasoning  is  different.  When  we  explore  near  the  bottom  of 
the  tree,  the  loss  of  search  power  in  the  larger  tree  occurs  because  of  the  increased 
Independence"  of  the  goal  nodes.  In  the  smaller  tree,  if  the  left  branch  is  not  a  goal 
node  with  value  "1",  that  fact  increases  the  probability  that  the  right  branch  is  a 
goal  node  with  value  "1”  (because  there  are  a  fixed  number  of  such  goals).  Hence  if 
the  left  branch  fails  to  give  us  the  hoped-for  "1",  the  right  branch  has  better  than  its 
•priori  chance  of  doing  so.  The  same  is  true  in  the  larger  tree,  but  the  increase  in 


probability  it  less  (tbe  two  nodes  are  closer  to  independent),  to  the  gain  from  search 
is  also  less. 


Conjecture  11:  For  1  <k  s  log  n, 

r 

fk(Zp,Zn)  <  ft(p.n)  with  equality  iff  p  =0  or  p  =n. 

Results  9  and  10  established  this  statement  for  the  two  extremal  strategies 
(searching  before  tbe  first  move  and  searching  just  before  the  last  move).  It  seems 
likely  that  the  statement  holds  for  the  in-between  strategies  as  well.  Computer 
results  in  Appendix  B  establish  the  truth  of  this  conjecture  for  n  <  128. 

Result  12:  For  any  constant  a  between  0  and  1, 
lim /]( an, n)  =  0 

II  -MO 


Proof:  from  formula  2  of  Result  2. 


/  s(  jjr +  i>n) 


4 


) 


n  .n/2  +  1.  .n/2  -  1. 

4  'n/4  +  1*  1  n/4  1 


*  £±± 
4n 


-n/2  +  1.  -n/2  - 1. 
*n/4+  1*  '  n/4  1 


( 


n 

n/2 


) 


-*  0  as  n-*» 


Use  Stirling’s  formula  to  demonstrate  this  convergence. 

Worn  Results,  /t(p,n)  Is  maximized  when  p  »  —•♦I.  Result  12  follows  by 
dominated  convergence.  ■ 

In  Result  12,  we  fix  the  proportion  of  Ml"s  at  a  and  explore  at  tbe  root  of 
Increasingly  deep  trees.  The  result  says  that  for  large  enough  trees  a  single 


exploration  of  the  two  subtrees  of  the  root  of  the  game  tree  prior  to  the  player's  first 
move  adds  almost  nothing  to  his  expected  score.  This  is  quite  predictable:  the 
player  is  too  far  from  the  goal  nodes  when  he  receives  his  information!  for  it  to  avail 

r 

-him  at  all. 

^Conjecture  13:  For  any  constant  a  between  0  and  1, 
and  for  any  fixed  positive  integer  Jb , 

lim  fk(an,n)  =  0 

This  conjecture  is  a  slight  extension  of  Result  12  and  should  follow  from 
Result  12  as  a  corollary.  Since  k  is  fixed,  exploration  takes  place  a  long  way  from  the 
goal  nodes  (just  as  in  Result  12).  so  one  would  expect  search  to  add  almost  nothing 
to  the  player’s  expected  score. 

Result  14:  For  any  constant  a  between  0  and  1, 

=  a(l-a) 

Proof  :  from  Result  4, 

«»/*,.(«».»>  =  Jim 

„  Bn.  «(!-«)" 

n  —  1 

*  a(l-a)  • 

This  interesting  result  gives  the  convergence  behavior  for  the  player  who 


searches  only  at  the  last  possible  moment.  His  expected  gain  from  that  search  is  the 
product  of  the  fraction  of  goal  nodes  with  value  "1"  and  the  fraction  of  goal  nodes 
with  value  "0”. 
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Suppose  we  were  to  assign  the  goal  nodes  value  "l"  or  "0"  independently  with 
Pr('T')  =  a.  We  would  expect  Result  14  to  approximate  (and,  in  the  limit,  equal) 
behavior  of  last-minute  search  on  such  game  trees.  An  easy  calculation  of  the 
expected  improvement  by  last-minute  search  on  such  trees  does  in  -fact  yield  the 
lame  answer  a(l-a)  as  given  in  Result  14. 

» 


4.  Conclusions  and  Further  Research 

Given  limited  resources,  what  search  strategy  is  best?  Ve  selected  a  model  In 

™w- 

which  to  answer  this  question,  wherein  we  made  precise  such  concepts  as  "search 
"strategy”  and  "resources”.  No  claim  is  made  that  the  model  is  the  onlyjtlausible  one, 
'_por  that  it  accurately  represents  real-world  games  or  decision-making.  The  model 
was  selected  for  three  reasons.  First,  it  isolates  that  which  we  wish  to  study; 
uncertainty  arising  from  incomplete  search.  Second,  the  model  is  simple  enough  to 
define  the  problem  precisely  and  to  allow  hopes  of  obtaining  analytic  results.  Third, 
the  trees  allowed  and  evaluation  function  used  are  sufficiently  generic  to  model 
many  interesting  games  played  with  many  kinds  of  strategies. 

The  model  features  a  division  of  "strategy"  into  "search  strategy"  and  "move 
strategy";  resources  specified  as  number  of  node  evaluations  allowed;  node 
evaluations  described  as  "exploration",  wherein  the  player  learns  the  probability 
mass  function  of  possible  outcomes  were  he  to  move  at  random  beneath  the 
evaluated  node;  and  the  meta-player  assumption  that  all  assignments  of  goal  node 
values  to  goal  nodes  consistent  with  the  given  root  blind  search  pmf  are 
equiprobable. 

Ve  analyzed  a  class  of  strategies  called  one-time  k  strategies,  on  a  class  of  trees 
called  (p.n)  trees.  For  these  trees  with  these  strategies,  we  proved  the  following 
results,  among  others. 

1.  A  short  formula,  recursive  in  p,  exists  for  /t(p,n).  For  k  >2,  /»(j>,«i)  can  be 
expressed  as  a  short  sum,  each  of  whose  terms  includes  an  /  j  term. 

£.  The  longer  the  player  postpones  march,  the  better  the  strategy.  That  Is, 
/*  </ft«|.  for  1st  <  log  n.  Hence  the  optimal  strategy  (among  those  allowed  in 
the  restricted  case)  is  to  explore  at  the  leaves  of  the  game  tree.-  Further,  this 
result  [due  in  part  to  Bruce  Ballard}  applies  even  If  we  allow  the  goal  nodes  to 
have  values  other  than  ”0"  and  "1". 


->  «r 


S. 


The  benefit  from  search  is  greatest  in  trees  for  which  about  half  of  the  goal 
nodes  have  value  “1"  and  half  have  value  "0".  More  precisely,  we  can  graph 
/ft(p.n)  as  a  continuous  function  of  p.  For  k  fc  2  (and  approximately  for  k  =  l). 


/*(p,n)  is  a  concave  function  symmetric  about/) 


In  deep  trees,  search  at  the  root  gains  nothing  for  the  player.  That  is,  the  one¬ 
time  1  strategy  is  no  better  than  random  (no-search)  play.  Search  just  above 
the  leaves  (the  one-time  log  n  strategy)  gains  a  (l-a),  where  a  Is  the  fraction  of 
goal  nodes  with  value  "1". 

The  girdle  we  wore  herein  to  obtain  analytic  results  can  be  loosened  in  two 
natural  ways.  First,  we  might  consider  trees  with  more  than  two  possible  goal  values. 
For  example,  we  might  consider  a  (p,n)  tree  with  one  or  two  (in  general,  r)  goal 
nodes  allowed  to  have  a  third  value.  Second,  we  might  consider  more  complicated 
strategies.  For  example,  we  might  consider  allowing  two  (in  general,  f )  explorations, 
each  at  any  level  of  the  tree.  Each  of  these  extensions  is  under  current 
investigation. 

The  long-term  goal  of  this  research  is  to  compute  the  optimal  search  strategy  in 
the  unrestricted  model.  One  hopes  that  progress  toward  that  goal  will  help  us  better 
understand  our  intuitive  idea  of  "search  with  limited  resources". 
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6.  Appendix  A  —  Proofs 

0.1.  Proof  of  Result  1 

r 

^Result  t:  /*(p.n)  =  /*(n-p,n). 

'  Proof:  Fix  k  and  n  throughout  ihe  proof. 

Recall  that  in  the  one-time  k  strategy,  the  player  moves  randomly  to  level  k  -1 
of  the  tree,  explores  the  two  subtrees  beneath  him,  moves  to  the  subtree  with  higher 
blind  search  expectation,  and  then  moves  randomly  for  the  rest  of  the  game.  For 
any  (m,n)  tree  played  acoording  to  the  one-time  k  strategy,  define  the  following 
random  variables. 

Ah  =  fraction  of  ‘T'-valued  goal  nodes  in  the  left  subtree  explored. 

Ah  =  fraction  of  "T'-valued  goal  nodes  in  the  right  subtree  explored. 

Bh  =  fraction  of  "0"-valued  goal  nodes  in  the  left  subtree  explored. 

Bh  *=  fraction  of  "O'-valued  goal  nodes  in  the  right  subtree  explored. 

These  random  variables  are  not  independent  of  each  other.  However,  because 
the  player  Is  using  a  one-time  k  strategy  in  an  (m.n)  tree,  their  distributions 
depend  on  only  m,  n  and  k .  Since  n  and  k  are  fixed,  we.  omit  noting  the  dependence 
on  n  and  k . 

Stip  i:  (A£-9.A£-p)*>  (f£.  ££),  where  w  stands  for  "has  the  same  (joint) 
distribution  as**.  This  is  true  because  when  we  Interchange  the  Hl”s  and  N0”s  in  the 
goal  values  of  a  ( n -p , n )  tree,  we  obtain  a  (p.n)  tree  for  which  T's  are  interpreted 
as  M0ns  and  vice-versa.  and  refer  to  the  ”lMs  in  a  (n-p ,n)  tree,  while  J9j 
and  Bp  refer  to  ihe  ”0"s  in  a  (p.n)  tree.  Hence  their  joint  distributions  are  identical. 

Skip  B:  Ap  ♦  fij  =  1  (therefore  Ap  =  1  -  Bp)  since  all  goal  nodes  in  the  left 
subtree  have  value  either  ”1"  or  "0".  Similarly,  Ap  *  1  -  Bp. 

9twp*  Slmax^-J-.^-^)  «  I  [max  \  J- 


.W- 


I 


Tbit  symmetry  result  occurs  because  having  one  branch  "bad"  is  (on  average) 
exactly  balanced  by  its  brother  being  "good".  More  precisely: 

■I[maxf4-  £.4?-  j|-J]  -  E[n»ax|£-4.  J 

t  *  2  [mo*  *4.  Afi)  -  -  (£  ♦  E  [max  {-X*. 

*=  E  [max  A£\]  +  E  [min  -  &- 


since  ma  x(~XrY)  =  -  min(.Y,  Y)  for  any  random  variables  X  and  Y 
*  E  [max  |^J,  -  &L 

■  tWH’l  -  £ 

since  max(jr.y)  +  mln(^.y)  =  X+Y  for  any  random  variables  X  and  Y 


=  e[4]  +  e [a;]  - 


.  JL  4.  £  - 

n  n  n 


n 

since  we  moved  randomly  to  level  I:  -1  of  the  tree 


e  0 


Stwp  4:  The  proof  of  Result  1  now  proceeds  as  follows.  By  definition  of  /*. 
fk(n-p,n)  s  E  [maxjAi-,.  At-pil  ~  bUnd  starch  tsptctation  itf  a(n-p.n)  free 

«  E  £fi]  -  by  Step  1 


E[n»*l$--(l-.*).£-(l-*)|] 


e  E[max{£--X^.  — Ap J] 

*  E  -  jj- .  -  ^-}] 

c  E  [mu(i^,  Ap\]  -  J- 
=  ft(p.n) 


by  Step  2 


by  Step  3 


by  definition  of 


bZ.  Proof  of  Rendt  2 
Result  2: 


/i(j>.">  -  ,  n 


<n/2> 


4  1  *  + 1 

1  n-p+1 

n«(  n  )  * 

n  ln/2;  1 

1  2 

0 

if  p=0  c 

1_ 

n 

If  p=l  i 

/  F  W  n"l> 

Mp/2  +  lJ)  M(n-p+l)/  Ej 


.  S  P—  /.(p-I.tQ  If  2sp  <n-Z  and  p  is  even 
n-p+1  7  1 


-E—  /,(p-l,»)  If  3 *p  «n-3  end  p  is  odd 

p-1 


if  p  =0  or  p»n 


1  tatfl  n-2i  l^r*KBl  2i+l 
n  M  n-2>+l  A&  *j 


If  1  <p  <n-l 


Proof:  (a)  first  formula  In  the  one-time  k  strategy,  the  player  examines  the 

two  subtrees  of  the  root  and  moves  to  whichever  subtree  has  more  goal  nodes  with 
value  "1"-  We  divide  the  possible  outcomes  of  the  exploration  into  eases:  case  j 

.  r 

means  the  selected  subtree  has  j  goal  nodes  with  value  ”1".  The  improvement  over 
blind  search  expectation  in  case  j  is  ("b.s.e."  stands  for  "blind  search  expectation"): 

-V 

expected  score  in  case  j  -  b.s.e.  ofa(p.n)  tree 

e  bs.e.  of  a  (j,  y)  tree  -  bs.e.  of  a  (p  ,n)  tree 

s  - JE- 

n/2  n 

■=  --  lZi-p]  C) 


We  need  to  compute  the  weight  of  each  case.  The  number  of  ways  to  select  the  j 
"l"s  in  the  chosen  subtree  is  (^).  The  number  of  ways  to  select  the  remaining  'TV's  is 

Further,  the  subtree  selected  could  be  either  on  the  left  or  on  the  right 
(except  for  the  p/Z  case,  to  be  handled  shortly).  The  number  of  ways  to  select  any 
subtree  of  the  root  is  (n/g)-  The  weight  of  case  y  is 


«  (?)  <ny  2  - 


C*) 


To  get  the  first  formula  in  Result  1,  we  multiply  the  improvement  (•)  in  each 
ease  by  the  weight  (**)  of  each  case,  and  sum  over  the  cases.  The  case  has  sero 
Improvement,  so  we  may  omit  that  case.  The  selected  subtree  must  then  bold  more 
than  half  of  the  p  goal  nodes  with  value  "1",  so  the  sum  begins  at  case  j  -  J  ♦  1  l 


The  sum  ends  when  we  have  exhausted  either  all  the  goal  nodes  with  value  "1" 


(J  =  p )  or  all  the  goal  nodes  in  the  subtree  (j  =  ™).  Since  (P)  is  interpreted  as  0  if 

2  J 


/  >  p .  we  can  write  the  sum  as  if  it  continues  until  ^  . 


(6)  second  formula.  One  can  prove  by  induction  on  m  the  formula  fjCNUT  73 J 


£  (J > (,!,) [*■  - <r««]  ■=  [m+l][(-m)(mr4.1)(1im> 


y-o 


This  formula  bolds  for  all  integers  r,  s,  f ,  and  m. 
Ve  have  from  the  first  formula  in  Result  2  that 


f,(p.n)  =  ■-*—  ¥  te-pHjX""') 

n  (n^2>  3  '  3 


2  I  -*]<;>  <  *  ■*> 


<t) 


!L=£±L 

b 


/  P  w  n  "R 
'lp/2  +  1  j  M(»-J>+1)/ 


This  last  step  follows  by  applying  (f)  with  r=p ,  k  =n-p .  f =£- ,  and  m»^  in  the  first 

s  s 

summation  and  m=|®- j  In  the  second  summation. 

(c)  third  formula.  first  suppose  p  is  even,  2  <p  <  n-2.  Applying  the  second 
formula  in  Result  2,  we  get 


P-~-  4-  1 

n-p+2 

2 

2 

/  P-1  X  f  -  . 

4(p”l)/2  4-  lj*  ll(n-J>+2)/ Bj1 


/,(p-l.n)  = 


4 


p/2'  v[n— p+2]  /  2 


'ft/ C' 


»'C2) 


£-1  ZL 

Z£±2  1 

l2l  l 

2  1 

£  +  i 

ILzZL 

2 

2 

lp/ 2 


f*1 


/  n-p  . 
l[n-p]/  2* 


n  -  p  +  1 
-n-p  4-2 
2 


/  p  v  /  n-p  v 
'p/2  +  1;  Hn-p]/  2  ’ 


n-p+1 

n-p 


since  p  is  even 


A  similar  application  of  the  second  formula  in  Result  2  yields  the  appropriate 
formula  for  odd  p.  The  p  »  0,  1,  n-1,  and  n  cases  also  follow  immediately  by 
applying  the  second  formula  in  Result  2. 

(d)  fourth  formula..  This  follows  directly  from  repeated  applications  of  the  third 
formula  in  Result  2.  ■ 


BA.  Proof  of  Result  5 

Basalt  6  [Ballard  and  Hutchler] :  for  1  <  k  <  log  n, 

/*(p.n)  «  /*«i(p.n) 

with  equality  iff  p  =0  or  p  =1  or  p  =n  -1  or  p  =n. 

Farther,  the  proof  does  not  depend  on  the  goal  node  values  being  restricted  to 
*0"  and  Hl".  and  works  for  any  complete  n-ary  tree. 

^waf:  Key  ideas  in  this  proof  were  supplied  by  Bruce  Ballard  after  a  conversation 


with  the  author. 
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Result  4  establishes  that  equality  holds  if  p  *  0.  1.  n-1,  or  n.  Let  2  £p  x  n— 2. 
Sttp  1:  Show  that /, (p, n)  </§(*>. *0- 

Let  the  random  variables  X,  Y,  W  and  Z  be  the  number  of  goal  nodes  wit^  value  "1"  in 
the  four  subtrees  having  root  at  level  2  of  the  (p,n)  tree,  respectively.  * 

t 

** 


. I . 

I  I 


II  II 

X  Y  W  Z 


Then  by  definition, 

«■[— *•] 

e  &E[m*x\X+Y.W  +  Zl]-B- 

ft  fl> 

8ince  the  one-time  2  strategist  makes  his  first  move  at  random. 

*  |-|E[n»ax{Jr,rn  +  ®[^^.^|]]  -  J- 

Henoe  to  thorn  f^p.n)  <  fg(p.n)  it  will  suffice  to  show  that 

*[ma4r+r.  IT4E|]  <  E  [maxfJT.  Y\]  4  E  [maxflf.Z}] 

Mow  (Jf.Y)  »  (jf.lf)  and  (WJS)  *  (TJf),  where  s  stands  for  "has  the  same  joint 
distribution",  so  max (X, 7)  *  max (X,  IF)  and  max(W.Z)*max{Y.Z).  Taking 
expectations,  we  get 


.V. 


*  -l"!  *  "I  ,  *• 


*>  if 


E  [maxjK.J''}]  =  E  [maxjZ,  *TJ]  and  E  [mnxj  Jy.ZJ]  =  E[max{y,ZJ]  (•) 

For  any  real  number!  (hence  any  random  variables), 

r” 

tnaxpT+  Y .  W  +  Z\  <  maxpf.Wj  +  maxJF.ZJ  so 

E  [maxJK  +  Y ,  F  +  Zfl  <  E  [max{Z.  W\  +  maxf  Y.Zfl 

Further,  this  inequality  is  strict  as  long  as  Pr  ( X>  W  and  Y<Z)  is  non-zero.  Since 
E  scp  <  n— 2,  such  is  the  case  here.  We  have 

E  [maxJJT  +  F ,  W  +  Z\]  <  E  [max{Z,  W\  +  max{  Y.Z\] 

«=  E  [maxpf.lfj]  +  E  [maxfy.ZJ] 

*  E  [maxpr.FJ]  +■  E  [maxj  W.ZJ]  by  (•)  above 

As  noted  earlier,  this  suffices  to  conclude  Step  1  of  the  proof. 

Step  2:  Show  that  /*(p,n)  <  /s«(p,n)  if  2<*<logn. 

ftip.n)  «=  /  j  applied  to  a  random  subtree  with  root  at  level  k  -1 

sc  /B  applied  to  a  random  subtree  with  root  at  level  k  —1 

(because  / ,  «  /g  on  any  tree) 

*  /*+i(f>.*0 

Further,  the  inequality  is  strict  because  there  is  a  non-sero  probability  that  the 
random  subtree  with  root  at  level  k  -1  has  between  two  and  all  but  two  goal  nodes 


with  value  ”1".  • 


*7 


6.4.  Proof  of  Result  6 


Result  6: 


/ i(p.n)  >  /,(p-2.n)  If  2«p  <  f 


fi(p.n)  >  /i(p+2.n)  ifg-*p*n-2 


/i(p.n)  <  /»(p-l.n)  if  p  it  even 


/i(p.*0  >  /i(p-l.n)  if  p  it  odd 


to  particular,  for  fixed  n,  f  t(p ,n)  is  largest  when  p  =  ~-l  or  p  =  2-  +  1. 

C  C 


PToof:  (a)  Suppose  2sps  ^  Then  p  <  n-p  so  p -2  <  n-p  and  p -1  <  n-p+1. 
It  follows  that 


£ — <  - w  ^  ■  and 
p-1  n-p-t-1 

Enl  <  P-P.t1 
p  n-p +2 


For  p«2,  the  result  is  triviaL  For  larger  even  p ,  Result  2  shows  that 


f^p.n)  =  jj^^/^p-l.n) 

*  ^  5  /  i(p  -2,n)  using  Result  2  again,  on  odd  p-1 

VI  ••p  T1  p*6 

But  from  (•),  we  have  -n~*  >  1,  so  /,(p.n)  >/, (p-2.n)  for  even  p.  For 

fl— P+1 

odd  p.  Result  2  shows  that 


/i(p.w)  *  Z?t/i(P“***) 


*  rv  _  _  ,  o  /i(P  ~2.n)  uiing  Result  2  again,  on  even  p  -1 

fl  “p  rc 

Since  (••)  Implies  that  -J—  >  1.  we  have  that /,(p,n)  > /,(p-2.n)  for  odd 

P“1  “P  TC 

f>  - 

» 

•(b)  If  £n-2,  part  (a)  of  this  proof  and  the  symmetry  condition  of  Result  1 

entail  that /,(p,n)  >/i(p+2,n). 

(o)  If  p  is  even,  from  Result  2 

/i(p.n)  =  n-y  +  t  /»(P-I.n) 

<  /i(j»-l.»)  since  <  1 

(d)  If  p  is  odd,  from  Result  2  we  have 

/i(j>.w)  =  ^j-/i(p-l.n) 

>  /j(p-ltw)  since  >  1 

p-i 


6.5.  Proof  of  Result  0 

Result  9:  /,(2p,2n)  <  /j(p.n)  with  equality  iff  p=  0  or  pan. 

Proof:  If  p  =0  or  p=n,  the  result  follows  from  Result  4.  Let  0  <p  <  n. 
5Ksp  1:  Show  true  for  even  p . 

Stasis  cose  (p  *  £): 

«  2^-4  3  2n-2  _1_ 
tn-3  2  2n-l  2n 


/i(4.8n) 


by  repeated  application  of  Result  2 


n-2  3(n-l)  1_ 

e(»-|)  2(n-i)  B 


<Si«4]Ln41.  1  <  _1 


3  x  n  -1  n 

4<n“8> 


n-H  n-1 


n-2  1_ 
n-1  n 


if  n  fe  3  (true  here) 


=  /  i(2.n) 


by  Result  2 


Induction  step:  Assume  true  torp  - 2  (p  even,  p  *  4).  Show  true  for  p . 


/  i(2p,2n) 


En-Ep  Bp  - 1  2n -2p  +2  gp— 3 
2n-2lp  +1  2p  —  2  En  — 2p+3  Zp-4 


ft(Zp-4.Zn) 


by  repeated  application  of  Result  Z 


< 


En-Ep  Bp  - 1  2n-2p+2  Ep-3  ,  » 

Zn-Zp  41  Bp -2  2w-2p  +3  Ep-4  *  ' 


by  the  induction  hypothesis 


«  Zpzl  gy^-JP-tg.  gp-?-  Ez±  5— Pt.iL /.(p.n) 

En-^p+l  ^p-2  2n-2p+3  Zp-4  p-l  n-p 


C) 


by  repeated  application  of  Result  E 

But  ealculations  show  that  the  coefficient  of  /  i(p  »n)  in  the  line  marked  (•)  is 
lees  than  or  equal  to  1  precisely  when  y  a  ^  4-1.  Hence  the  inducUon  step  fellows 

for  y  a  For  larger  even  p,  the  result  follows  from  the  symmetry  condition  In 

m 


Result  1. 


40 


Stop  B:  Show  true  for  odd  p . 
Soda  cost  (p  *  1): 


Bn.  —2  1 

/ 1(  B,  8n )  *  r-  by  two  applications  of  Result  2 


n-1  _1_ 
2n-  1  n 


<  — 
n 


/  i(X.n) 


Induction,  stop:  We  will  show  true  for  odd  j>  >  1,  using  Step  1  as  the  "induction 
hypothesis".  Let  p  >  1  be  odd. 

/,(».&!)  ■=  |jpf /l(»-Z.an)  by  Result  2 

<  ^ /  i(p  _  l.n)  uring  Step  1,  since  3p -Z  is  even 

*  En-'sjp+f  *••“«  * 

/.<*■«> 


</»(P.«) 
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6.  Appendix  B  - 

Depth  of  0-1  tree  *  1 
Number  of  goal  nodes  «  2 


Number  Improvement  from  learning  about  level 
of  I'm  1 


0  0.0000 

1  0.5000 

2  0.0000 


Depth  of  0-1  tree  ■  2 
Hub  be  r  of  90a!  nodes  *  4 


Humber  Improvement  from  learning  about  level 
of  l's  1  2 


0  0.0000  0.0000 

1  0.2500  0.2500 

2  0.1667  0.3333 

3  0.2500  0.2500 

4  0.0000  0.0000 


1 

Depth  of  0-1  tree  » 

3 

i 

Nun be r 

of  9oal 

l 

» 

• 

■ 

8 

Number 

Improvement  from  learning  about  level 

% 

<  - 

of  I'm 

1 

2 

3 

i  l 

0 

0.0000 

0.0000 

0.0000 

\ 

1 

0.1250 

0.1250 

0.1250 

V* 

2 

0.1071 

0.1786 

0.2143 

♦V  * 

3 

0.1607 

0.1964 

0.2679 

4 

0.1286 

0.2000 

0.2857 

5 

0.1607 

0.1964 

0.2679 

1 

6 

0.1071 

0.1786 

0.2143 

3 

7 

0.1250 

0.1250 

0.1250 

8 

0.0000 

0.0000 

0.0000 

Depth  of  0—1  tree  ■  4 
Rumber  of  goal  nodes  «  16 

Humber  Improvement  from  learning  about  level 
of  l's  1  2  3  4 


0 

0.0000 

0.0000 

0.0000 

0.0000 

1 

0.0625 

0.0625 

0.0625 

0.0625 

2 

0.0583 

0.0917 

0.1083 

0.1167 

3 

0.0875 

0.1089 

0.1411 

0.162  5 

4 

0.0808 

0.1214 

0.1637 

0.2000 

5 

0.1010 

0.1307 

0.1788 

0.2292 

6 

0.0918 

0.1370 

0.1882 

0.2500 

7 

0.1071 

0.1405 

0.1933 

0.2625 

8 

0.0952 

0.1416 

0.1949 

0.2667 

9 

0.1071 

0.1405 

0.1933 

0.2625 

10 

0.0918 

0.1370 

0.1882 

0.2500 

11 

0.1010 

0.1307 

0.1788 

0.2292 

12 

0.0808 

0.1214 

0.1637 

0.2000 

13 

0.0875 

0.1089 

0.1411 

0.1625 

14 

0.0583 

0.0917 

0.1083 

0.1167 

15 

0.0625 

0.0625 

0.0625 

0.0625 

16 

0.0000 

0.0000 

0.0000 

0.0000 

Depth  of  0-1  tree  ■  5 
Nun be r  of  goal  nodes  *  32 

Number  Improvement  from  learning  about  level 
of  I'm  1  2  3  4  5 


0  0.0000 

1  0.0313 

2  0.0302 

3  0.0454 

4  0.0438 

5  0.0547 

6  0.0527 

7  0.0615 

8  0.0590 

9  0.0664 

10  0.0635 

11  0.0699 

12  0.0666 

13  0.0721 

14  0.0683 

15  0.0732 

16  0.0689 

17  0.0732 

18  0.0683 

19  0.0721 

20  0.0666 

21  0.0699 

22  0.0635 

23  0.0664 

24  0.0590 

25  0.0615 

26  0.0527 

27  0.0547 

28  0.0438 

29  0.0454 

30  0.0302 

31  0.0313 

32  0.0000 


0.0000  0.0000 

0.0313  0.0313 

0.0464  0.0544 

0.0567  0.0720 

0.0648  0.0856 

0.0716  0.0964 

0.0772  0.1052 

0.0820  0.1125 

0.0860  0.1186 
0.0895  0.1237 

0.0923  0.1280 

0.0947  0.1315 

0.0966  0.1343 

0.0980  0.1365 

0.0990  0.1380 

0.0996  0.1389 

0.0998  0.1392 

0.0996  0.1389 

0.0990  0.1380 

0.0980  0.1365 

0.0966  0.1343 

0.0947  0.1315 

0.0923  0.1280 

0.0895  0.1237 

0.0860  0.1186 
0.0820  0.1125 

0.0772  0.1052 

0.0716  0.0964 
0.0648  0.0856 

0.0567  0.0720 

0.0464  0.0544 

0.0313  0.0313 

0.0000  0.0000 


0.0000  0.0000 

0.0313  0.0313 

0.0585  0.0605 

0.0821  0.0877 

0.1024  0.1129 

0.1198  0.1361 

0.1347  0.1573 

0.1472  0.1764 

0.1577  0.1935 

0.1665  0.2087 

0.1736  0.2218 

0.1793  0.2329 

0.1838  0.2419 

0.1872  0.2490 

0.1895  0.2540 

0.1909  0.2571 

0.1913  0.2581 

0.1909  0.2571 

0.1895  0.2540 

0. 1872  0. 2490 

0.183  8  0.2419 

0.1793  0.2329 

0.1736  0.2218 

0.1665  0.2087 

0.1577  0.1935 

0.1472  0.1764 

0.1347  0.1573 

0.1198  0.1361 

0.1024  0.1129 

0.0821  0.0877 

0.0585  0.0605 

0.0313  0.0313 

0.0000  0.0000 


Depth  of  0-1  tree  *  6 
Umber  of  goal  nodes  -  64 


(timber  leprovenent  from  learning  about  level 
Of  l's  1  2  3  4  5  56 


• 

• 

* 

— 

0 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

1 

0.0156 

0.0156 

0.01 56 

0.01 56 

0.0156 

0.0156 

2 

0.01 54 

0.0233 

0.0273 

0.0293 

0.0303 

0.0308 

3 

0.0231 

0.0268 

0.0363 

0.0412 

0.0439 

0.0454 

4 

0.0227 

0.0333 

0.0436 

0.0517 

0.0567 

0.0595 

5 

0.0284 

0.0372 

0.0496 

0.0610 

0.0687 

0.0732 

6 

0.0279 

0.0405 

0.0548 

0.0692 

0.0798 

0.0863 

7 

0.0325 

0.0435 

0.0593 

0.0765 

0.0902 

0.0990 

8 

0.0320 

0.0462 

0.0634 

0.0830 

0.0998 

0.1111 

9 

0.0359 

0.0487 

0.0670 

0.0888 

0.1087 

0.1228 

10 

0.0353 

0.0509 

0.0703 

0.0941 

0.1170 

0.1339 

11 

0.0388 

0.0529 

0.0733 

0.0989 

0.1247 

0.1446 

12 

0.0381 

0.0548 

0.0761 

0.1032 

0.1318 

0.1548 

13 

0.0413 

0.0565 

0.0786 

0.1071 

0.1383 

0.1644 

14 

0.0405 

0.0581 

0.0809 

0.1107 

0.1444 

0.1736 

15 

0.0433 

0.0596 

0.0831 

0.1140 

0.1499 

0.1823 

16 

0.0425 

0.0609 

0.0851 

0.1170 

0.1550 

0.1905 

17 

0.0451 

0.0622 

0.0869 

0.1197 

0.1596 

0.1982 

18 

0.0442 

0.0633 

0.0885 

0.1222 

0.1638 

0.2054 

19 

0.0466 

0.0644 

0.0900 

0.1245 

0.1676 

0.2121 

20 

0.0456 

0.0653 

0.0914 

0.1266 

0.1711 

0.2183 

21 

0.0479 

0.0662 

0.0927 

0.1285 

0.1742 

0.2240 

22 

0.0467 

0.0670 

0.0938 

0.1302 

0.1770 

0.2292 

23 

0.0489 

0.0676 

0.0948 

0.1317 

0.1795 

0.2339 

24 

0.0477 

0.0683 

0.0957 

0.1330 

0.1816 

0.2381 

25 

0.0497 

0.0688 

0.0965 

0.1342 

0.1835 

0.2418 

26 

0.0484 

0.0693 

0.0972 

0.1352 

0. 1851 

0. 2450 

27 

0.0502 

0.0697 

0.0977 

0.1360 

0.1864 

0.2478 

28 

0.0489 

0.0700 

0.0982 

0.1367 

0.1875 

0.2500 

29 

0.0506 

0.0702 

0.0986 

0.1373 

0.1884 

0.2517 

30 

0.0492 

0.0704 

0.0988 

0.1376 

0.1890 

0.2530 

31 

0.0508 

0.0705 

0.0990 

0.1379 

0.1893 

0.2537 

32 

0.0493 

0.0705 

0.0990 

0.1379 

0.1894 

0. 2540 

33 

0.0508 

0.0705 

0.0990 

0.1379 

0.1893 

0.2537 

34 

0.0492 

0.0704 

0.0988 

0.1376 

0.1890 

0.2530 

35 

0.0506 

0.0702 

0.0986 

0.1373 

0.1884 

0.2517 

36 

0.0489 

0.0700 

0.0982 

0.1367 

0.1875 

0.2500 

37 

0.0502 

0.0697 

0.0977 

0.1360 

0.1864 

0.2478 

38 

0.0484 

0.0693 

0.0972 

0.1352 

0.1851 

0. 2450 

39 

0.0497 

0.0688 

0.0965 

0.1342 

0.1835 

0.2418 

40 

0.0477 

0.0683 

0.0957 

0.1330 

0.1816 

0.2381 

41 

0.0489 

0.0676 

0.0948 

0.1317 

0.1795 

0.2339 

42 

0.0467 

0.0670 

0.0938 

0.1302 

0.1770 

0.8292 

43 

0.0479 

0.0662 

0.0927 

0.1285 

0.1742 

0. 2240 

44 

0.0456 

0.0653 

0.0914 

0.1266 

0.1711 

0.2183 

47 


0.0466 

0.0644 

0.0900 

0.0442 

0.0633 

0.0885 

0.0451 

0.0622 

0.0869 

0.0425 

0.0609 

0.0851 

0.0433 

0.0596 

0.0831 

0.0405 

0.0581 

0.0809 

0.0413 

0.0565 

0.0786 

0.0381 

0.0548 

0.0761 

0.0388 

0.0529 

0.0733 

0.0353 

0.0509 

0.0703 

0.0359 

0.0487 

0.0670 

0.0320 

0.0462 

0.0634 

0.0325 

0.0435 

0.0593 

0.0279 

0.0405 

0.0548 

0.0284 

0.0372 

0.0496 

0.0227 

0.0333 

0.0436 

0.0231 

0.0288 

0.0363 

0.0154 

0.0233 

0.0273 

0.0156 

0.0156 

0.0156 

0.0000 

0.0000 

0.0000 

0.1245 

0.1676 

0.2121 

0.1222 

0.1638 

0.2054 

0.1197 

0.1596 

0.1982 

0.1170 

0.1550 

0.1905 

0.1140 

0.1499 

0.1823 

0.1107 

0.1444 

0.1736 

0.1071 

0.1383 

0.JL644 

0.1032 

0.1318 

0.11548 

0.0989 

0.1247 

0.1446 

0.0941 

0.1170 

0.1339 

0.0888 

0.1087 

0.1228 

0.0830 

0.0998 

0.1111 

0.0765 

0.0902 

0. 0990 

0.0692 

0.0798 

0.0863 

0.0610 

0.0687 

0.0732 

0.0517 

0.0567 

0.0595 

0.0412 

0.0439 

0.0454 

0.0293 

0.0303 

0.0308 

0.01 56 

0.01 56 

0.0156 

0.0000 

0.0000 

0.0000 

Depth  of  0-1  tree  «  7 
Hunber  of  goal  nodes  >128 


Umber  Improvement  from  learning  about  level 


of  l's 

1 

2 

3 

4 

5 

*  6 

7 

0 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

1 

0.0078 

0.0078 

0.0078 

0.0078 

0.0078 

0.0078 

0.0078 

2 

0.0078 

0.0117 

0.0137 

0.0146 

0.0151 

0.0154 

0.0155 

3 

0.0116 

0.0145 

0.0182 

0.0206 

0.0220 

0.0227 

0.0231 

4 

0.0115 

0.0169 

0.0220 

0.0260 

0.0284 

0.0298 

0.0305 

5 

0.0144 

0.0189 

0.0251 

0.0307 

0.0345 

0.0367 

0.0378 

6 

0.0143 . 

0.0207 

0.0279 

0.0350 

0.0402 

0.0433 

0.0450 

7 

0.0167 

0.0223 

0.0304 

0.0388 

0.0455 

0.0497 

0.0521 

8 

0.0165 

0.0238 

0.0326 

0.0424 

0.0505 

0.0559 

0.0591 

9 

0.0186 

0.0252 

0.0347 

0.0456 

0.0553 

0.0619 

0.0659 

10 

0.0185 

0.0265 

0.0366 

0.0486 

0.0597 

0.0677 

0.0726 

11 

0.0203 

0.0277 

0.0383 

0.0513 

0.0639 

0.0733 

0.0792 

12 

0.0201 

0.0289 

0.0400 

0.0539 

0.0679 

0.0788 

0.0856 

13 

0.0218 

0.0299 

0.0415 

0.0563 

0.0717 

0.0840 

0.0920 

14 

0.0216 

0.0309 

0.0430 

0.0585 

0.0752 

0.0890 

0.0982 

15 

0.0232 

0.0319 

0.0444 

0.0606 

0.0786 

0.0939 

0.1043 

16 

0.0230 

0.0328 

0.0457 

0.0626 

0.0818 

0.0986 

0.1102 

17 

0.0244 

0.0337 

0.0470 

0.0645 

0.0848 

0.1031 

0.1161 

18 

0.0242 

0.0345 

0.0482 

0.0663 

0.0877 

0.1075 

0.1218 

19 

0.0255 

0.0353 

0.0494 

0.0680 

0.0904 

0.1117 

0.1274 

20 

0.0253 

0.0361 

0.0505 

0.0697 

0.0930 

0.1157 

0.1329 

21 

0.0265 

0.0368 

0.0515 

0.0712 

0.0955 

0.1196 

0.1382 

22 

0.0263 

0.0375 

0.0525 

0.0727 

0.0978 

0.1234 

0.1435 

23 

0.0275 

0.0382 

0.0535 

0.0741 

0.1001 

0.1270 

0.1486 

24 

0.0272 

0.0388 

0.0544 

0.0755 

0.1022 

0.1304 

0.1535 

25 

0.0284 

0.0395 

0.0553 

0.0768 

0.1042 

0.1338 

0.1584 

26 

0.0281 

0.0400 

0.0562 

0.0781 

0.1062 

0.1370 

0.1631 

27 

0.0292 

0.0406 

0.0570 

0.0793 

0. 1081 

0. 1401 

0.1678 

28 

0.0289 

0.0412 

0.0578 

0.0804 

0.1098 

0.1430 

0.1722 

29 

0.0299 

0.0417 

0.0585 

0.0815 

0.1115 

0.1458 

0.1766 

30 

0.0296 

0.0422 

0.0592 

0.0826 

0.1132 

0. 1486 

0.1809 

31 

0.0306 

0.0427 

0.0599 

0.0836 

0.1147 

0.1512 

0.1850 

32 

0.0303 

0.0431 

0.0606 

0.0846 

0.1162 

0.1536 

0.1890 

33 

0.0312 

0.0436 

0.0612 

0.0855 

0.1176 

0.1560 

0.1929 

34 

0.0309 

0.0440 

0.0619 

0.0864 

0.1190 

0.1583 

0.1966 

35 

0.0318 

0.0444 

0.0624 

0.0872 

0.1203 

0.1605 

0.2002 

36 

0.0315 

0.0448 

0.0630 

0.0881 

0.1215 

0.1625 

0.2037 

37 

0.0323 

0.0452 

0.0635 

0.0888 

0.1227 

0.1645 

0.2071 

38 

0.0320 

0.0455 

0.0640 

0.0896 

0.1238 

0.1664 

0.2104 

39 

0.0328 

0.0459 

0.0645 

0.0903 

0.1249 

0.1682 

0.2135 

40 

0.0325 

0.0462 

0.0650 

0.0910 

0.1259 

0.1699 

0.2165 

41 

0.0333 

0.0465 

0.0654 

0.0916 

0.1269 

0.1715 

0.2194 

42 

0.0329 

0.0468 

0.0659 

0.0922 

0.1278 

0.-1730 

0.2222 

43 

0.0337 

0.0471 

0.0663 

0.0928 

0.1287 

0.1745 

0.2248 

44 

0.0333 

0.0474 

0.0667 

0.0934 

0.1295 

0.1758 

0.2274 

49 


45  0.0340 

46  0.0336 

47  0.0343 

48  0.0339 

49  0.0346 

50  0.0342 

51  0.0349 

52  0.0344 

53  0.0351 

54  0.0346 

55  0.0353 

56  0.0348 

57  0.0354 

58  0.0349 

59  0.0355 

60  0.0350 
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